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Holographic reduced representations (HRR) are based on superpositions of convolution-bound n- 
tuples, but the n-tuples cannot be regarded as vectors since the formalism is basis dependent. This 
is why HRR cannot be associated with geometric structures. Replacing convolutions by geometric 
products one arrives at reduced representations analogous to HRR but interpretable in terms of 
. geometry. Variable bindings occurring in both HRR and its geometric analogue mathematically 

' correspond to two different representations of ^2 x • • • x (the additive group of binary n-tuples 

I with addition modulo 2). As opposed to standard HRR, variable binding performed by means 

■ of geometric product allows for computing exact inverses of all nonzero vectors, a procedure even 

simpler than approximate inverses employed in HRR. The formal structure of the new reduced 
O ' representation is analogous to cartoon computation, a geometric analogue of quantum computation. 
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I. INTRODUCTION 



Reduced representations of cognitive structures are based essentially on two operations (binding and superposing) 
whose algebraic realizations vary from model to model. In where matrices representing roles act on vectors 
representing fillers, binding corresponds to matrix multiplication and superposition to vector addition. In tensor 
• representations roles and fillers are represented by vectors which are bound by means of tensor products. The 
resulting simple tensors are superposed by addition. In holography-inspired memory models 0, S S B S 
binding is represented by convolution. Replacing tensor products by circular convolutions one arrives at holographic 
' reduced representations (HRR) [ll|, [l^] ■ Restricting frequency-domain HRR to a subspace and switching to appro- 
^ ^ . priately defined 'logarithmic' variables one obtains binary spatter codes (BSC) [I3,[IJj[3j with binary strings of 
I ■ length n bound by n-dimensional sums mod 2 and superpositions modeled by majority-rule sums. Finally, in quantum 
\^ i computation (QC) [l^ bits are bound into n-bit numbers by means of tensor products of two-dimensional complex 

■ vectors called qubits. QC is mathematically similar to tensor-product reduced representations, but differences occur 
at interpretational levels p7| . 

I i Convolutions may be regarded as basis-dependent lossy compressions of the tensor product. The degree of com- 
f — ■ pression can be estimated by means of dimensional analysis. In particular, circular convolutions occurring in HRR 
, map pairs of n-tuples into n-tuples. In contrast, the ordinary convolution of two n-tuples is a (2n — l)-tuple, and 
^ ■ an analogous tensor product would produce a n^-tuple. These facts explain efficiency and usefulness of HRR in 
. ^ , applications [l^] ■ 

■ In spite of what one can often read in the literature, a convolution of two vectors is not well defined. This 
5h ' means that having two vectors, that is — geometric objects, we cannot unambiguously identify a geometric object 

. . . I corresponding to their circular convolution. This seems to be a drawback, at least at the conceptual level. Geometry 
of some sort is at the roots of visualization, and visualization seems important for mathematical understanding and 
proving fisl [l9l . [20I [2]| . Hence the question: Is it possible to replace circular convolution by something similar but 
geometrically meaningful? If so, is there a relation to HRR? 

We will argue that the most natural choice is to replace tensor products by geometric products 0|, and not by 
circular convolutions. Geometric products, similarly to circular convolutions, preserve dimensionality at the level of 
multivectors . Multivectors are superpositions of blades, geometric-product analogues od simple tensors. Geometric 
products are also 'exponents', in a sense that will be made precise later, of n-dimensional sums mod 2. In consequence, 
geometric-product binding is in a unique relation to the binding employed in BSC, and the latter is a form of HRR. 

Coding based directly on geometric products was recently applied to QC [Ij, lU, |2^ (a somewhat less direct 
way of linking geometric products with QC was used earlier in [26|). As it turned out, all quantum algorithms 
of the standard formalism have geometric analogues. However, as opposed to standard QC that requires quantum 
mechanical implementations, the formalism based on geometric algebra (GA) requires geometry and not quantum 
mechanics. In principle, any system involving some geometry (Euclidean or not) is a candidate for implementation 
of a quantum algorithm. Systems where HRR are applicable might therefore, at least in principle, perform quantum 
algorithms. 
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The concept of GA is not new — it appeared in the 19th century works of Grassmann [IJ and Ghfford [1^ — but 
geometric insights behind GA were forgotten for almost a century. At the end of 1960s the subject was revived with the 
works of Hestenes ^ . Today the Hestenes system [13, HH, [13] has found apphcations (cf . [H [si, [si, [H [sS, [H, S SO] ) 

to topics as diverse as black holes, cosmology, quantum mechanics, quantum field theory, supersymmetry, beam 
dynamics, computer vision, robotics, protein folding, neural networks, computer aided design, and recently — quantum 
computation. The link between HRR and GA suggests that the next step is to reformulate in a GA way the cognitive 
science. 

The paper is organized as follows. Section II introduces GA and its basic constructions (multivectors, invertibility, 
coding based on blades) and explains why GA naturally formalizes relations between geometric objects. In Section III 
we compare geometric product with circular convolution and explain why the latter cannot be interpreted in geometric 
terms. In Section IV we discuss the Fourier-space convolution algebra and show that it is in a one-to-one relation 
with the algebra of commuting matrices. In Section V we explain why variable binding in Fourier-space HRR is a 
representation, in group-theoretic sense, of the group Z2 x ■ ■ ■ x Z2. Then, in Section VI we show that blades form a 
projective representation the same group and thus convolution binding is naturally represented in GA. We illustrate 
the new reduced representation in Section VII by reformulating the example Kanerva gave as an illustration of his 
BSC. Finally, in Section IX we reformulate the same example by means of a matrix representation of GA. 

II. ALGEBRAIC REPRESENTATION OF GEOMETRIC RELATIONS 

Consider the following set of relations « involving two-dimensional basic shapes: 



1 (1) 

-I « (2) 
-□ « (3) 

(4) 



One can think of them in at least two categories. One is simply a category of understanding relations between one- 
and two-dimensional objects: Square is formed from two orthogonal segments, a segment and a square imply which 
segment is missing, 1 means identity... Another way of looking at these relations, more in the spirit of Grassmann 
and Clifford, would be in terms of an algebra of geometric objects if associativity is assumed and 1 is treated as a 
neutral element. Associativity then implies, for example, — |— □« |. Let us make here a side remark 

that the 'algebra' formalizes a procedure that resembles an IQ test. 

The next step is to ask for higher-dimensional generalization and inclusion of orientation: Oriented line segments 
are vectors, plane segments have 'sides', the relations between them will include a positive or negative sign, and we 
can also add cubes (having 'insides' and 'outsides'), their walls, and even higher dimensional structures. 

Orientation makes the algebra noncommutative 

+□ (5) 
-□ (6) 
T T « 1 (7) 

if we assume that 'first up then right' generates the righthanded orientation, opposite to the lefthanded 'first right 
then up'. Adding both relations we find ^ T + T 0. Taking three arrows and using associativity we obtain 
another, similar rule: □ ^ H > □ ss 0. The proof goes as follows 

□ ^«^t^«^(-n) (8) 

However, we cannot simultaneously assume ^^Ri||R:; 1 and □□ ~ 1. Indeed, anticommutativity of — s-fw — 
implies 

□□«^t^T« — >^tT« -11 « -1 (9) 

so we have to decide at which level to define the algebra. One can also think of this example as a hierarchy of 
geometric structures with increasing dimensions and different metric signatures. The first level is the pair {— >, f} and 
the Euclidean-space signature is (+,+). The second level is {1,— >,!,□} and the signature is (-1-,+,+,—), known 
from space-time pseudo-Euclidean geometry. 
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The type of construction we have just outhned led Grassmann and ChfFord to the algebra based on the concise 
formula 

bkbi+bibk = 2Skil. (10) 

Here the 6s denote orthonormal basis vectors in some n-dimensional real Euclidean space, 1 is the neutral element 
of the algebra, and Sm is the Kronecker delta. The 2D plane example is reconstructed from (fTO|) if bi =^, 62 =t, 
6162 = □ = 612. 

The algebra pUj) is known as the Clifford algebra and may be regarded as the grammar of GA. It refers to a concrete 
basis, but can be reformulated in a basis-free way. Indeed, consider two vectors x = J2k=i ^kbk and y = Vkbk- 
Their geometric product reads 

n 

xy = ^Xkyk^ + ^ixkyi - ykxi)bkbi (11) 

k=l k<l 



x-y xAy 

The geometric product xy is a sum of two terms. The scalar x ■ y = y ■ x is known as the inner product. The bivector 
X A y = ^y A X is the outer product. In 3D the length of x Ay represents the area of the parallelogram spanned by x 
and y. 

In arbitrary dimension the bivector x Ay represents an oriented plane segment. Grassmann and Clifford introduced 
geometric product by means of the basis-independent formula involving a multivector 

xy = x- y + xAy (12) 

which implies (jlOp when restricted to the orthonormal basis. Inner and outer product can be defined directly from 
xy: 

x-y = ^{xy + yx), (13) 

X Ay \i^y~ y^)- (14) 

The most ingenious element of (fT2|) is that it adds two apparently different objects: A scalar and a plane element. 
This seems 'wrong' but this is precisely what happens when we speak of complex numbers or extend space and time 
to space-time. Apparently, the person to be blamed for the fact that multivectors may nowadays seem weird is Gibbs 
(4l| . who was more famous at the time than Grassmann or Clifford, and spoiled their work by separating the geometric 
product into two separate operations — losing associativity and invertibility, as we shall see shortly. 

Geometric interpretation and visualization of multivectors can be formulated in various ways, and various interpre- 
tations can be found in the literature. Perhaps the easiest way of getting used to thinking in GA terms is to browse 
through the websites devoted to GA (cf. ^]). The approach we found useful for multi-bit problems of QC was a 
representation in terms of directed colored polylines |25| . 

Geometric product for vectors a;, y, z can be defined by the following rules: 

{xy)z = x{yz), (15) 

x{y + z) = xy + xz, (16) 

{x + y)z — xz + yz, (17) 

x^ = \x\\ (18) 

where is a positive scalar called the magnitude of x. The rules imply that x ■ y must be a scalar since 

xy + ya;=|2; + yp-|a;|2-|y|2. (19) 

GA allows to speak of inverses of vectors: x~^ = x/\x\'^ . x is invertible (i.e. possesses an inverse) if its magnitude is 
nonzero. Geometric product of an arbitrary number of invertible vectors is also invertible. The possibility of invert- 
ing all nonzero-magnitude vectors is perhaps the most important difference between GA and tensor or convolution 
algebras. 

Geometric products of different basis vectors 



bki...kj — bki ■ . . bkj , 



(20) 
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ki < ■ ■ ■ < kj, are called blades. In n-dimensional (pseudo-)Euclidean space there are 2" different blades. This can 
be seen as follows. Let {xi, . . . , x„} be a sequence of bits. Blades in an n-dimensional space can be written as 

c.,....„ =6r ...6?;" (21) 

where — 1, which shows that blades are in a one-to-one relation with n-bit numbers. This observation is at the 
roots of the GA reformulation of QC introduced in [23J. A general multivector is a linear combination of blades, 

1 

= X! i^Xi...Xr,Cxi...Xr,, (22) 

Xi ...Xn—0 

with real coefficients ipxi...x„ [46| . 

An inverse of a multivector is a well defined notion but not all multivectors are invertible. To find an inverse of a 
multivector is not an entirely trivial task in general. It resembles an analogous problem of inverting matrices. But all 
blades and geometric products of invertible vectors are invertible. 



III. CIRCULAR CONVOLUTION VS. GEOMETRIC PRODUCT 



We have mentioned in Section I that convolutions are not defined on vectors but only on n-tuples. Let us explain 
this statement in more detail on the example of circular convolution. Circular convolution x ® y of the n-tuples 
X = {xo, . . . ,a;„_i), y = {yo, . . . ,y„-i) is defined as 



{x®y)j 



For pairs the formula ([23]) reads explicitly 



Xo 
X\ 



^ ^ '^kyj — k mod n ■ 
fc=0 



xayo + xiyi 
xoyi + xiyo 



(23) 



(24) 



Let us note that if we tried to interpret (j24p in terms of vectors we would have to implicitly assume that the pairs 
on both sides of (|24p correspond to the same basis (otherwise the formula would be completely ambiguous). So let 
us take two different bases {607 ^'i} and {bp, b[}, and two vectors x, y. Each of these vectors can be written in both 
bases: 



X = xobo + xibi = Xgb'f^ + x[b[, 
y = yobo + yibi = j/obj, + y[b'^. 

Circular convolutions of vectors would be meaningful if in any two bases we would find 

x®y = {xoyo + xiyi)bQ + (xpyi + a;iyo)bi = {x'oyQ + x[y[)b'„ + {x'^y'^ + x[y'Q)b[ 

which is not the case. Indeed, let us take the basis rotated by tt/2 (bp = 61, b[ ~ —bo, x'q = xi, x\ 

y'l = -yo) 



(25) 
(26) 



(27) 



= -xa, yo = yi, 



X — Xgbg 



x\b\ = .Tibi + (-.To)(-6o), 

v'oK + v'l^'i = J/i^i + (-yo)(-bo), 



implying 



[x'^y'Q + x\y'^)b'Q + (x^y^ + x\y'^b\ = {xiyo + Xoyi)6o + (xoVo + Xiyi)bi 

^ {xoVo + xiyi)bo + {xoyi + xiyo)bi. 

In contrast, for the geometric product we find 

xy = {xoyo + xiyi)l + {x^yi - .Tiyo)bobi = [x'^y'^ + x{y[)l + {x'^y'^ - a;iyo)^>o^i, 



(28) 
(29) 



(30) 
(31) 



(32) 



which does not depend on the choice of basis. Let us note that the difference between geometric product and circular 
convolution boils down in this example to a single change of sign and reshuffling of components. To understand the 
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latter property we have to bear in mind that the GA of a 2D plane is 2^-dimensional. A general multivector is here 
of the form ip = al + (3bQ + jbi + Sbobi. Our calculation, in terms of the 4-tuples {a, /3, 7, S), reads 







/ 




yo 




Xi 


yi 




\ / 


\ / 


V 



xoV^ + xiyi 



xoVi - xiyo 



(33) 



There do exist matrix representations of GA (cf. Section IX). It is known, however, that matrix representations of GA 
are not the most efhcient implementations of GA-bascd algorithms. The algorithms that work efficiently in practice 
are based on direct calculations performed in terms of the GA rules (cf. [43j). 



IV. CIRCULAR CONVOLUTION IN THE FOURIER SPACE VS. MATRIX ALGEBRA 

A general multivector (|22p can be represented by the 2"-tuple (V'Oi...o„, • • ■ The neutral element 1 corre- 

sponds in this notation to (1, 0, . . . , 0). 

Similarly, the neutral element of the ©-algebra of n-tuples is the n-tuple / = (1,0, ...,0). By definition, the 
©-inverse of the n-tuple x satisfies x~^ ® x = I. An important map is the 'involution' 

{x )j — jniodn- (34) 

Let us now rewrite ® and * in the Fourier space. The Fourier transform of (a;o, . . . ,x„_i). 



Xk = ^x,e-2-'='/«, (35) 

satisfies 



{x®y)k = XkVk, (36) 
{x*)k = Xk, (37) 
(x* ® y)k = Xkijk, (38) 

where Xk denotes complex conjugation. The Fourier transform of / = (1, 0, . . . , 0) is I — (1,1,..., 1). Thus 

(J^)fe = ^. (39) 

Xk 

X is not ®-invertible if any component of its Fourier transform is 0. This is why exact inverses are not used in standard 
HRR. Plate explains in |12l | why x* may be regarded as an approximate inverse of x, and why in the presence of noise 
— a generic situation in HRR — application of exact inverses would lead to unstable algorithms. Only in the case 
of unitary x (i.e. such that x* — x^^, \xk\ — 1) the approximate inverse is exact. In GA, in contrast to HRR, exact 
inverses of nonzero vectors always exist, do not lead to instabilities, and are easy to calculate since x~^ = x/\x\'^. 

Circular convolution in the Fourier space is thus equivalent to multiplication of diagonal matrices. Accordingly, 
the ©-inverse is the matrix inverse, and involution means Hermitian conjugation. The notion of ®-unitarity coincides 
with matrix unitarity. Fourier-space HRR involves binding represented by the matrix product of diagonal matrices 
and superposition is performed by matrix addition. HRR is implicitly an operator procedure but involving only 
commuting operators. These operators are in general neither Hermitian nor unitary but have the property of being 
normal, i.e. commute with their Hermitian conjugates. 

Plate mentions in (Section 3.6.7) that commutativity can cause ambiguities, so certain noncommutative variants 
of ® may be in principle considered. For example, combination of ® with permutations of components introduces 
noncommutativity for the price of associativity. Still another alternative mentioned in fl3| is to work with vectors 
that can be written as matrices (i.e. with n = m?, for some m) and use matrix multiplication. Apparently, this kind 
of reduced representation has not been studied in the literature so far. 

Our claim is that the GA formalism is a natural noncommutative alternative to HRR, but to appreciate it we have 
to go deeper into the structure of the Fourier-space HRR. 
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V. FROM FOURIER-SPACE HRR TO BSC 

Consider a general HRR-type Fourier-space superposition of N diagonal matrices Uj: ili — X^jLi Uj. Now let us 
restrict Uj to matrices of the form Uj = g^'^^^j = (— where are diagonal matrices whose only nonzero 
elements are equal to 1. In other words, a diagonal of P^- is a sequence of bits: Pxj = diag(xj^i, . . . , Xj^n), Xj^k = 0, 1. 
Such a Pxj is a projector: P^. — Px^. Under these restrictions the diagonal unitary matrix Uj has the diagonal 
consisting of (— 1)^^.*= = ±1. The next step is to consider the new diagonal matrix '5 = sign('0) defined via the 
spectral theorem from 

• r \ f +1 forx > 

^' is again a unitary diagonal matrix whose only nonzero elements are equal to ±1 and hence can be written as 
vj/ = e™^^ = (— l)''^^. Px = diag(a;i, . . . , Xn) is a new projector, i.e. a diagonal matrix with bits on the diagonal. In 
effect, we have produced a new binary sequence (a;i, . . . , x„) from a collection of N binary sequences {xj^i, . . . , Xj^n)- 
The relevant formula (majority-rule summation) reads 

1 ^ 1 

xk = fflf=ix„fc = ©(^ E - 2) (4^^ 



where 



is the Heaviside step function. 

The final step leading to BSC is to treat each Uj as a product of two unitary diagonal matrices Rj and Fj, also 
consisting of pluses and minuses on diagonals, 

TV AT JV 

* = sign(V') - (-1)^^^ = sign(E^.^;) = s\gn{Y,{-lf'^^{-lf^^) = sign(E(-l)^''^^®''"^^)- (43) 

Rj, Px- represent roles, Fj, Py. are fillers, and Px^ © Pyj denotes matrix addition mod 2. 

Since Pxj and Py^ are diagonal matrices with Os and Is on the diagonals, say, Pxj = diag(a;j.i, . . . ,Xj^„), Py^ = 
diag(2/j,i, . . . , %>), the map 

{Xi,...,Xn) = Sf^j^{Xj^i,...,Xj^ri)®{yj,l,---,yj.n) (44) 

is the thresholded majority-rule componentwise addition of n-dimensional sums mod 2 (n-dimensional exclusive al- 
ternatives, XORs). 

Now consider a single bit X and a sequence of N bits {xi, . . . ,xn)- Then the following distributivity of © over ffl 
holds true: 

X ® ( fflf^i X,) = fflf^i {X © X,) . (45) 

naturally generalizes to the n-dimensional variants of ffl and XOR. Eq. (|^^ is the BSC where binary strings are 
bound by © and superposed by thresholded addition. Decoding of information is based in BSC on (|45)) . 

Let us rephrase the main result as follows. Circular convolution of n-tuples whose entries consist of ±1 may be 
regarded as a multiplicative representation of XOR of n-bit strings, and the appropriate map is 

x®y^ {-l)(P^®Py^ = {-if^^ {-ify = RF. (46) 

The link between HRR and BSC is given by the map x i— > (—1)^^, where x on its left-hand side is a binary string of 
length n while on the right-hand side x occurs at the diagonal of an n x n matrix Px- 

In the next Section we will see that geometric product represents the same structure but in a projective way. 
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VI. GEOMETRIC PRODUCT AS A PROJECTIVE REPRESENTATION OF XOR 



Let xi . . . Xn and ?/i be binary representations of two n-bit numbers x and y. Now let us consider two blades 

Cx = Cx^...x-n = V . . 5^", Cy — Cy^,,,y^ — . . . . Wc wUl sliow that geometric product of Cx and Cy equals, up to 
a sign, CxQy In this sense the map a; i— > c^, is an analogue of the exponential map x i— > (—1)^=". 

Let us begin with examples: 

hihi = C10...0C10...0 = 1 = C0...0 = C(io...o)e(io...o) (47) 

61612 = C10...0C110...0 — 616162 = 62 = C010...0 = C(io...o)e(iio...o) (48) 

61261 = C110...0C10...0 = 616261 = -626161 = -62 = -C010...0 = -C(iio.. .0)0(10. ..0) (49) 

61257626 — C11001010...0C0100010...0 ~ 616265676265 

= (—1)^61656667 = (— l)'^cioooiiio...o = (^l)'°C(iiooioio...o)©(oioooio...o)- (50) 

The number D is the number of times a 1 from the right string had to "jump" over a 1 from the left one during the 
process of shifting the right string to the left. 

The above observations, generalized to arbitrary strings of bits, yield 

Indeed, for two arbitrary strings of bits we have 

D = yi{x2 H 1- .T„) + y2{x3 H h a:„) H 1- yn-iXn = ^ ykXi- (52) 

k<l 

We conclude that the map 

(xi, . . . ,x„) X (yi, ...,?/„) 1-^ (xi, . . .,Xn) ® (2/1, ...,?/„) = (a;i © 2/1, ... ,a;„ © 2/„) (53) 

is projectively (i.e. up to a sign) represented in GA by means of ((5T|) . 

Representations 'up to a sign' play an important role in physics and are at the roots of many phenomena such as 
half-integer spin and fermionic statistics. To the best of our knowledge the link between projective representations of 
XOR and GA was noticed for the first time in the preliminary version of this paper [3] 



VII. GEOMETRIC ANALOGUE OF HRR 

Let us begin with illustrating the original BSC by means of the example taken from [1^ . The records are represented 
by unstructured randomly chosen strings of bits. The encoded record is 

PSmith = (name © Pat) ffl (sex© male) ffl (age © 66). (54) 

Decoding of the "name" looks as follows 

Pat' = name © PSmith 

= name © [(name © Pat) ffl (sex © male) ffl (age © 66)] 
= Pat ffl (name © sex © male) ffl (name © age © 66) 

= Pat ffl noise Pat. (55) 

We have used here the involutive nature of XOR and the fact that the "noise" can be eliminated by clean-up memory. 
The latter means that we compare Pat' with records stored in some memory and check, by means of the Hamming 
distance, which of the stored elements is closest to Pat'. A similar trick could be done be means of circular convolution 
in HRRs, but then we would have used the inverse name"^ or the involution name*, and an appropriate measure of 
distance. Again, the last step is comparison of the noisy object with the "pure" objects stored in clean-up memory. 
This is how standard BSC works. 

We can now use the exponential map x 1-^ (—1)^"= to turn BSC into HRR. Let us, however, proceed in the geometric 
way and employ x t—^ Cx- The roles and fillers are represented by randomly chosen blades; 



PSmith = 



name ■ Pat + sex • male + age • 66. 



(56) 
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The dot "•" is the geometric product and ffl is replaced, similarly to HRR, by ordinary addition. At the level of 
explicit blades the record corresponds to the multivector P Smith 

PSmith — CQj^...a„C2;j...a;^ + Cbj...b„Cyj...j,^ + Cci...c„Czj^...2j^. (57) 

The blades indexed by the beginning of the alphabet represent roles (name, sex, age) while the remaining ones 
correspond to the fillers (Pat, male, 66). The decoding looks as follows 

name -PSmith = Cai...a„[cat...a„Cxi...x„ + Cb^...b„Cy^...y„ + Cci...c„Czi...z„] (58) 

Caefeey i Caecez (59) 
= ±Pat + noise. (60) 

The signs have to computed by means of (jSTj) . 

An analogue of clean-up memory can be constructed in various ways. One possibility is to make sure that fillers, 
Cx etc. are orthogonal to the noise term. For example, let us take the fillers of the form Cxj^...xkO...Oj where the first 
k ^ n bits are selected at random, but the remaining n — k bits are all 0. Let the roles be taken, as in Kanerva's 
BSC, with all the bits generated at random. The term C(^xi...x„)(Biyi...Vn)®{yi...y„) ^^^^ with high probability contain 
at least one yj — 1, k < j < n, and thus will be orthogonal to the fillers. The clean-up memory will consist of vectors 
with yj = 0, k < j < n, i.e of the filler form. 



VIII. BINARY CODING IN DIFFERENT BASES 



In quantum mechanics bits can be associated with any set of qubits (i.e. with any basis in a 2-dimensional complex 
space). The freedom to choose the basis is crucial for quantum cryptography, but is generally not used in QC. In QC 
one typically works in the so-called computational basis, which is fixed in advance. This, of course, does not change 
the fact that the whole formalism of QC is based on vectors and not on rt-tuples. 

A similar situation occurs in our GA analogue of HRR. A multivector ijj (22) is a combination of blades, and 
blades represent binary numbers only when we fix the basis. To put it differently, the same single multivector tp 
can be associated with different reduced representations, but whether this freedom is of any practical use is an open 
question. 



IX. CARTAN REPRESENTATION OF CLIFFORD ALGEBRAS 



It is useful to be able to work with matrix representations of GA. Although this is not an efficient way of doing 
GA computations, matrix representations allow to perform independent cross-checks of various GA constructions and 
algorithms. In this section we give an explicit matrix representation of GA. We begin with Pauli's matrices 

'^i = ( ? n ) ' ^2 = ( ? 7/ ) ' '^3 = ( J ^ ) • (61) 



^ 1 y ' ^ \i J ' ^ V "1 / 

GA of a plane is represented as follows: 1 = 2x2 unit matrix, bi — cri, 62 — o'2, &12 = cio'2 = if^s- Alternatively, we 
can write cqo = 1, cio = ci, Cqi =172, cn — ia^, and 

^oocoo + ^roco + ^o.cor + ^ncn = ( ^ %l I ) ■ (62) 

This is equivalent to encoding 2^ = 4 real numbers into two complex numbers. 

In 3-dimensional space we have 1 = 2x2 unit matrix, bi = (Ti, 62 = (T2, 63 = ca, 612 = o'icr2 = 1173, 613 = uia^ = 
-«cr2, 623 = 0-20-3 = icTi, 6123 = 0-1CT2O3 = i. 

Now the representation of 

E, ^/'OOO + i^/'lll + "0001 + #110, '0100 + ^^/'Oll - ^^/'OlO - V'lOl \ fQo\ 

VABC ABC - I ^^^^ _|_ -^^^^ _|_ -^^^^ _|_ ^^^^^ ^^^^ _|_ -^^^^ _ ^^^^ _ I 

ABC=0,1 ^ ' 



is equivalent to encoding 2^^ = 8 real numbers into 4 complex numbers. 
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An arbitrary n-bit record can be encoded into the matrix algebra known as Cartan's representation of Clifford 
algebras [45| : 

b2k = 0-1 (g) ■ ■ ■ (g) 0-1 (g) 0-2 8) 1 ■ ■ ■ tgi 1 , (64) 

n-k fc-1 

62fc-i = Q-i g) ■ ■ ■ (g 0-1 ig) 0-3 8) 1 Ig) ■ ■ ■ g) 1 . (65) 

n-k fe-1 

So let us return to the example of Pat Smith. For simplicity take = 4 so that we can choose the representation 

Pat ciioo, 

male — ciooo, } fillers (66) 
66 = coioo, 

name = cioio, 

sex = Com, ^ roles (67) 
age = cioii. 

The fillers have only the first two bits selected at random, the last two are 00. The roles are numbered by randomly 
selected strings of bits. 

The explicit matrix representations are: 

Pat — ciioo 61^2 = (cti ® CTi ® CTi (g 0-3) (cti (g CTi (g CTi (g 0-2) = 1 1 ® 1 (g (-icTi) (68) 

male = ciooo = 61 = (Ti g) cri g) ci g) cr3 (69) 

66 = coioo = 62 = 0-1 g) 0-1 g) CTi g) 0-2 (70) 

name = cioio = 61^3 = (cti (g cti ® cti (g cr3)(o-i (g cti (g 0-3 (g 1) 

= 1 g) 1 (g (-102) (g as 

sex = Com = 62fc3&4 = (fi ^ cti ^ ci o'2)(o'i cri 0-3 l)(o'i cti 0-2 ^ 1) 

= (Ti (gCTi (g {-il) g) CT2, (71) 

age = cioii = bibsbi = {ai g) cti g) cti g) o-3)(cri g) 0-1 g) 0-3 g) l)(o-i g) cti g) 0-2 "X) 1) 

= CTi (g CTi (g (-il) (g 0-3 (72) 

The whole record — where the superposition is taken for clarity with arbitrary parameters a, (3, and 7 — reads 

PSmith = a name • Pat + /3 sex • male + 7 age • 66 

= CKCioioCiioo + /3coiiiCiooo + TCioiiCoioo 
= acouo - /3ciiii + 7C1111 

The two noise terms are here linearly dependent by accident. This is a consequence of too small dimensionality of 
our binary strings (four bits, whereas in realistic cases Kanerva suggested IC* bit strings). This is the price we pay 
for simplicity of the example. Decoding the name involves two steps. First 

name • PSmith = cioio • PSmith = cioio ["Cquo - {P - 7)ciiii] 
= -aciioo - (/? - 7)coioi 

= -gPat -(/3 - 7)coioi = -a M2 -(/3 - 7)^2^4 ^ Pat'. (73) 

noise Pat noise 

It remains to employ clean-up memory. But this is easy since the noise is perpendicular to Pat. Wc only have to 
project on the set spanned by the fillers (i.e. the blades involving neither 63 nor 64), and within this set check which 
element is closest to the cleaned up Pat'. 

X. CONCLUSIONS 



In order to switch from a binary string x, occurring in BSC, to HRR, one employs the exponential map x 1— > (—1)^=^ 
where x plays a dual role. At the left-hand side x is just a sequence of bits distributed over a n-tuple. At the 
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right-hand side the bits are distributed over the diagonal of a diagonal n x n matrix P^. Binary strings equipped with 
componentwise addition mod 2 (i.e. ©, XOR) form a group. The exponential map is a representation of this group 
in the space of diagonal matrices: x ®y (^—I'^Px^Pv = 1)-^!'. 

This group possesses also a projective representation in the space of blades of a GA: x (B y Cx®y = iCxCy. 
Blades have a straightforward geometric interpretation. As opposed to tensor products, that increase dimensions, the 
dimensions of Cx, Cy and Cx®y are the same. Therefore, Cx®y can be used to bind variables. A superposition of such 
bound variables, a multivector, is a reduced representation analogous to HRR. 

GA may also be interpreted as a way of encoding mutual geometric relations between multidimensional geometric 
objects. For example, a pair containing an oriented plane element and a vector from this plane is mapped in GA into 
a vector which shows how to move the first vector in order to produce the oriented plane segment in question. The 
algebraic operation thus reveals a geometric property of the plane segment, and resembles the process of understanding 
geometry. 

We find the latter observation at least intriguing. It suggests that association of GA with cognitive science is not 
just a mathematical curiosity, but may be deeply rooted in the ways we think. 
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